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USING  LINEAR  THEORY  FOR  OBTAINING  UNBIASED 
ESTIMATE  OF  USEFUL  SIGNAL 

-  USSR  - 


/Following  is  a  translation  of  the  article  "Unbiased  Esti¬ 
mate  of  a  Useful  Signal  Which  Depends  Non-Linearly  on  Un¬ 
known  Parameters"  by  I.  A.  Boguelavskiy  in  Avtomatika  i 
Telemekhanika ,  Vol.  XXI,  No.  1,  Moscow,  January  1960”,  pages 


A  method  is  presented  which  makes  it  possible  in  a  number  of  cases 
to  employ  linear  theory  for  obtaining,  in  the  presence  of  noise,  un¬ 
biased  estimate  of  a  useful  signal  which  depends  nonlinearly  on  unknown 
parameters. 


#  *  *  *  * 

References  /l  -  4/have  solved  the  problem  of  obtaining,  in  the 
presence  of  noise,  the  optimum  estimate  from  some  viewpoint  of  a  useful 
signal  which  is  a  linear  function  of  unknown  parameters.  In  a  number 
of  cases  of  practical  importance  the  useful  signal  is  a  non-linear 
function  of  these  parameters.  The  general  solution  of  the  correspond¬ 
ing  non-linear  problem  was  obtained  by  V.  S.  PUGACHEV. 

(/Note/  Reports  of  1 6  February  and  2  March  1959  at  the  Seminar 
on  Probablistic  methods  of  the  Theory  of  Automatic  Control  at  the 
Institute  of  Automatics  and  Telemechanics,  Academy  of  Sciences  USSR.) 

However,  there  is  a  definite  practical  interest  in  artificial 
methods  which  effectively  solve  this  problem  in  some  cases  through  the 
use  of  linear  methods  of  statistical  dynamics.  One  of  these  methods  is 
set  forth  below.  The  method  makes  it  possible,  for  example,  to  accom¬ 
plish  rather  simply  the  unbiased  filtration  of  a  random  process  whose 
useful  signal  satisfies  a  non-linear  differential  equation  of  a  definite 
type  with  unknown  initial  conditions.  The  method  can  be  used  for 
smoothing,  without  dynamic  errors,  the  coordinates  and  projections  of 
the  velocity  of  an  artificial  earth  satellite  cosmic  rocket  traveling 
on  the  passive  sector  of  Its  motion,  etc. 
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Description  of  the  Method 


There  is  observed  a  random  process  21  (t)  in  the  form 

2-  (t)  =  <^  (^p,  *  *  *  *  > 

where  ^5  is  the  useful  signal, £  random  parameters,  andy-n^) 


noise. 


Let  it  be  possible  to  denote  a  transformation  X”  >  which  con¬ 
verts  <J>  into  the  function  of  the  form  0.^5  with  the 

a  priori  knowns  VV&  (£)  and  transformation^"  ,  which  converts  the 
result  of  the  employment  of  transformation^,  back  into  the  function 
Sp  .  In  addition,  let  us  assume  that  the  random  process  2 1  {*) 
is  the  result  of  application  of  transformation  .Z  to  21  (t)  can  be 
represented  approximately  in  the  form 

Z  1  $  ~  ^t)  +  l"l,(^)> 

/  .  |  ^ 

where  yy.  ^  (-t)  is  a  randmom  noise  process  whose  correlation  function 
can  be ''expressed  through  the  prcbablistic  characteristics  of  the  noise 

yyy\  (*)• 


Then  the  scheme  for  obtaining  an  unbiased  estimate  of  the  use¬ 
ful  signal  can  be  built  up  as  follows: 

1.  Apply  transformation  J~  to  ~Z-  (t  )  . 

2'.  Send  2  l  (t)  to  the  input  of  the  optimum  unbiased  . 

filtration  link  which  is  constructed  by  known  linear  methods  on 
the  basis  of  the  data  on  functions  i\/fc  (*)  and  the  noise  corre¬ 
lation  function  ^  p  (i);  in  the  memory  time  7"  selected  at 
the  output  of  the  link  is  developed  the  function  (t) 

with  decreased  random  errors.  ■#-> 

3.  Apply  transformation  jT  to  the  output  of  the  link. 

Realization  of  the  described  sequence_of  operations  insures  the 
construction  in  the  tir. e  ~"7  of  a  function  &  - +  )  without 

dynamic  errors  and  with  reduced  random  errors,  if  transformation  'CL' 
"raises "the  level  of  noise  at  the  output  of  the  optimum  linear  link 
only  insignificantly. 


Let  it  be  known  that  the  useful  signal  0  satisfies  a  non-linear 
differential  equation  of  the  form 


'V 


U) 


dlJ\ 

rf  .t  a 


f<T 


'i  7  ^  ^ 

Si  ^ 


4"™  Fit, 

U) 
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with  unknown  initial  conditions 
'<■  i  r  §  (G)>  t  2  Z  .  S 


f'(  ), 


■  >  «.  -  /■ 


x  C*-i) 

-  «*  (O) 


Due  to  the  presence  in  the  right-hand  member  of  (l)  of  the 
function  j~  (£,  }  )  in  this  case,  the  useful  signal  is  a  non-linear 
function  of  the  unknown  parameters  c  C  y/  .  From  (l)  it 

.r*  _  _ ^  x.  2 


follows  that 

(jj  (cl>  c2,  . 


/i. 


,  ()  r. 


r. 


<,k.  l>'p  (i)  7  j  ^  MUr, 


(2) 


./■  -k  -/ 

where  M/ £  (t  )  is  the  solution  of  the  homogeneous^  equation 
zj.  (f)d^u  „ ,  (t)  fciui  /  i  ,,  -r\ 

■  u,a.-r*  '  al  V  '  »•-■*/"  •  *  /  =  <  ' 

for  the  initial  conditions 

uJ,  W  (O)--/0  for”--l- 

£  j'  for .M-t, 

while  (yt)  (^-r)  is  the  pulse  transfer  function  of  the  corresponding 
linear  dynamic  link 

From  (2)  it  is  evident  that  transformation  T"  should  be  defined 
by  the  relation  ^  ^ 

7  1  W  -  ,/.  -  \  1(1  (/>-?-)  F  [t',_  (r)  ] ,  1 1> 


.1— 

and  transformation 


(3) 


the  relation 


,Z  ?  M  *Z*d>  f  ;W(Ot)  F  ft,  IF)  Ur,  (it) 

where  p'(0  signifies  the 'result  of  optimum  unbiased  filtration  of 
the  process  t7_  i  (/).  In  the  time  /  ,  given  in  the  solution  of  the 
problem  of  optimization,  Z  2  ( • )  will  differ  from  ./  (c^,  (  , , , 

r  ,f)  only  by  random  errors.  • 

U  'M 

As  a  rule,  it  is  possible  approximately  to  set  ~jh  /a  (£)  f 

if  only  the  link  with  the  pulse  transfer  function/!/  (f  posseses 
substantial  filtering  properties,  and  p  [t,  </  ]  is  of  the  same  order  as 

7  •  In  a  manner  analogous  to  the  above  we  can  obtain  an  unbiased 
estimate  of  the  result  of  application  of  any  given  linear  operator  v.5 
to  function  ch  . 


In  this  case 


where  Z. 
function  C 


&  C.P‘!  (Pt)  I-  Cr>Z( ' )  l.-t  ~  j 


:r2  (0  =  z"(t) 

(■t)  is  the  optimum  unbiased  estimate  in  time  J  of  the 


>'  C.  (J, 

k  K. 


(r) 
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We  note  that  for  a  given  function  <-£  (c  itc2>’‘>  c* 

corresponding  non-linear  differential  equation  may  he  found  by  exclu¬ 
sion  of  the  parameters  c ^  from  the  following  system  of  >i  j  1  algebriac 
equations : 


(t  -  £  (  C1  ,  C'2,  • 

d  4'  ~  fiirU  1,  C.  2, 

•  V  ^ 

rV'i  C-!  C2) 

dt’’  -L' 

However  the  transformation  (3)  and  (4)  can  be  used  directly  for 
obtaining  an  unbiased  estimate  only  in  the  case  when  the  non-linear 
member  of  the  obtained  differential  equation  depends  only  on y  and  f  . 

Using  the  concept  of  Jacobian  functions  ,  cf^}  — —  in  relation 

to  £  1  f  (‘  2} - we  can  obtain  an  analytical  expression  for  the 

condition  mentioned. 


For  ytt  -  1  this  condition  is  always  satTSflEa'J-TTHllS  ITT^Tfor 
example, 

—  £4-t  J 

CIS 

('-  -t)2  and  1 
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then 


cl  £ 

>7V* 


rt  r 


d  i: 


r  14  l 
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Supplementing  the  method  described  with  optimum  determination  of 
the  derivative  functions  of  2'  (~0  makes  it  possible  also,  in  conjunc¬ 

tion  with  the  method  of  successive  approximations,  to  find  an  unbiased 
estimate  when  there  is  a  dependence  of  the  non-linear  member  on  the 
derivative  functions  of  cp  . 


To  obtain  an  unbiased,  estimate  by  the  scheme  described  does  not 
require  the  solution  of  a- non -linear  differential  equation  Therefore, 
in  the  example  considered  below  the  scheme  makes  possible  an  uncomplicated 
solution  of  a  concrete  engineering  problem. 


Determination  of  Smoothed  Values  of  Trajectory 
Elements  of  an  Artificial^  Earth  Satellite 

Let  us  set  up  a  procedure  for  determining  without  dynamic,  errors 
the  smoothed  values  of  the  coordinates  and  projections  of  the  velocities 
of  artificial  earth  satellites.  To  shorten  the  treatment,  we  will 
examine  the  plane  case;  calculations  involved  in  smoothing  non-planar 
motion  of  a  satellite  cause  no  difficulties. 
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Let  x,  y  be  the  coordinates  of  the  satellite  relative  to  a 
rectangular  system  of  coordinates  which  do  not  participate  in  the 
Earth's  rotation  and  with  its  origin  at  the  center  of  the  Earth.  If 
the  influence  of  the  braking  force  of  the  Earth  s  atmosphere  on  the 
satellite  and  the  nonsphericity  of  the  Earth  are  not  taken  into  account, 
x,y  satisfy  the  non-linear  differential  equations 

x 

X  “  mf.  Mx2  f  y2)  3/2  ,  (5) 

_ y 

Y  s  <1x2  .  y2)  3/2,  (6) 

where  is  the  radius  of  the  Earth,  g  -  ^.Bltn/sec 


Therefore,  for 
\  (t)  r  x  (0  j 


example,  x  (■  )  is  described  by  the  formula 
x  (r-)t--  (  /2  (  v  _  r\  x  fr)  /  ^ 

jfcii)  0  ]  ^ 


j 


(7) 


or  the  formula 

/  (*)  js.  x(o)  cos  wt  si  n  wt  _ 

t  __  1 _ 

- L.  j  Sin  i.u  (+--")  x  (r)  1  [X1  (  t  )  x  -2  ^  ]  3/2 

_  I 

where  $1  -  /  “/"  . 


Formula  (8)  separates  the  part  of  the  useful  signal  which 
depends  linearly  on  the  unknown  parameters  A  (t')  andx  (t  )  more 
completely  than  formula  (7).  However,  the  filtering  effectiveness 
in  using  (7)  or  (8)  is  practically  identical.  Therefore  we  can  employ 
formula  (7),  which  makes  for  a  simpler  form  of  the  linear  operator 
which  accomplishes  the  optimum  unbiased  filtration  of  the  result  of 
transformation  .  Letthere  be  observed  the  random  process 

2  f  (f )  =  x  (t )  7 

where,}  ?(t)  is  the  random  errors  in  reasurement  of  coordinate  j.  (f) 
by  ground  radio  technical  or  optical  means. 


From  (7)  it  follows  that  transformation  J  is  defined  by  the 
re lax ion 


1  «*>  -//  (o  7  }  /  VoMO 


(9) 


/  [z  f  (r)-'2'  y  Cr)  1  3/2 


<  1 
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and  transformation  J[  by  the  relation 


X  2 


(f)  r 


2\  w 


x . ( i  , 

(t)-^  2|(r]  3/2  (10) 


The  specifics  of  the  problem  under  consideration  reduce  to  the 
fact  that  in  this  case  the  function  /,(- J  (ivr)  has  no  filtering  properties 
(when  using  (7)  or  (8)  0 '  (*,t)  is  equal  respectively  to  k  -tor 

1  sin  to  (t-t)).  Therefore  the  dispersion  of  noise  )r\-^  (^)  contained 
in  1  (^)  increases  infinitely  in  the  course  of  time. 

However,  if  7  is  limited  to  some  value  completely  acceptable 
for  practical  purposes  (see  appendix),  theh7r,\i  (t)  in  practice 
coincides  with  the  noise  (r) .  Therefore  for  the  known  correlation 
function  of  the  noise  -w  (f)  it  is  easy  to  construct  a  circuit,  con¬ 
verting  2-y\  (■’f")  into  2  /  (£)>  ^or  optimum  unbiased  filtration  of  the 
random  process  whose  useful  part  is  a  linear  function  of  time. 


Transformation  /J.  in  the  case  of  limitation  of  /  mentioned 
above  in  practice  does  not  reduce  the  effectiveness  of  this  filtration . 


The  random  errors  arising  in  measurements  of  the  ;/  coordinates 
are  subjected  to  unbiased  filtration  in  an  analogous  manner.  If  it 
is  necessary  to  find  V’x,  CO*  Vy  ("0  —  the  projections  of  the  velocity 
vector  of  the  satellite  —  then  transformation  X  >  as  previously,  is 
described  by  relation  (9),  while  transformation  7/;  takes  the  form: 


!  / 
■X 


(O 


a  m  -  r  zkm  . 

<  s  ^  * 

K  v is  the  result  of  optimum  unbiased  differentiation  of 
random  process  Z.  \l  (t). 


where  t/*  (-fc) 


the 


When  the  non -.epheri  city of  the  Earth  is  taken  into  account,  the 
smoothing  scheme  remains  unchanged,  if  only  the  constant  fj  in  the 
formulas  is  replaced  by  a  function  of  y  and  y.  ,  defined  by  known 
relations  of  potential  theory.  When  the  influence  of  the  atmospheric 
braking  force  on  the  motion  of  the  satellite  is  taken  into  account, 
coo.ooaents  depending  on  both  x,y  and  V-/  i4,  are  added  to  the  right- 
hand  member  of  equations  (5),  (6),  and  therefore,  to  the  functions  under 
the  integral  in  (9),  (lO),  The  form  of  these  components  is  known  if 
the  density  of  the  atmosphere  is  known  as  a  function  of  x,y  and  the 
coefficient  of  any  resistance  as  a  function  of  [/  .  Here  the  procedure 
becomes  somewhat  mor  complex,  requires  the  use  of  successive  approxima¬ 
tions,  and  can  be  designated  in  the  following  form.  First  v/and 
with  some  dynamic  errors  neglecting  the  influence  of  the  braking  force 
are  found  by  the  method  described  above.  The-//  and  \< t.  found  are  used 
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to  construct  components  which  take  into  account  this  force  and  supple¬ 
ments  to  the  functions  under  the  integral  in  (9)  and  (10)  when  the 
process  of  determining  new,  refined  values  of  \/,  is  repeated. 

Carrying  out  the  described,  procedure  several  times,  we  obtain  1 ff  and 
, 7:  practically  without  dynamic  errors  and  with  random  errors  determined, 
with  the  limitation  of  /  ,  fundamentally  by  random  errors  in  optimum 

differentiation.  We  note  that,  frequently,  successive  approximations 
cannot  be  employed  and  that,  instead  of  t/y  ,  we  use  the  results 

of  numerical  differentiation  with  a  specially  selected  spacing  of 


observed  values 


Without  alteration,  the  procedure  can  also  be  used  for  obtaining 
smoothed  values  of  the  coordinates  and  projections  of  the  velocity  of 
cosmic  rockets  which  are  in  complex  motion  under  the  influence  of  the 
gravitation  of  the  Earth  and  several  heavenly  bodies.  In  this  case  we 
introduce  terms  depending  on  both  x,  y  and  the  current  *£.  ,  into  the 
right  hand  members  of  equations  (5)  and  (6) ,  which  take  into  account 
the  variation  of  the  coordinates  of  these  bodies  relative  to  the  Earth 
during  the  smoothing  process. 
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APPENDIX 


We  will  designate  by  /">>  (l)  a  random  constituent  contained  in 
the  integral  components  of  formulas  (9).,  (.10),  resulting  from  the  presence 
of  random  errors  .  m  ;  (f),  Tn^  (i  )  and  will,  designate  its  dispersion  as 

We  will  consider  that  in  practice  the  magnitude  OfX  2  f  y2  is  . 
several  orders  greater  than  the  magnitude  ofj(x  hu.  */»% 

mi _ _ _  +■  r  <1 


Therefore 


A  M~ -  )  . '£  (■  ,)  (0 

i'  r  '  /  .  \  1  ..2  #  1  , 


f  r  (-).]  3/2 


P 


/,  C. 


and 


<  (O  <’cj>t?'rLy'  •' ■*> 

.  A  G  c  . 

where//.  2)  is  the  correlation  function  of  the  random  error 

-  ,/o  • 


(11  ) 


We  will  take 


SK  =•  - 

From  (ll)  it  follows  that,  in  this  case, 


r/V  -f:y.  / 


(0 


•j- 


!/  v 


d' 


2- 


/, 


(12) 


We  will  assume  for  definiteness  that  jg.  1  and  will  consider 

that  in  constructing  a  scheme  for  optimum  unbiased  filtration  which  con- 
Vyvts ;/*,(/;)  into  /,  *  (t)  and  in  computing  2  —  the  dispersion  of 

noise  on  the  output  of  this  scheme  —  /\  (  t)  can  be  neglected  (  .  ■  '! 

(  7.  iv  (/  )  ri  <*)  )> 

^  (4)  <  O.a  .  (13) 


?‘rom  (12)  it  follows  that  (13)  is  satisfied  when  (  1900 
In  this  case  the  pulse  transfer  function  of  the  optimum  scheme  is 
found,  and 


24  f  24  k'T  r  8,r 2  1  2 
24  j  24  ]  <  f  8  .  ■*  7  -  +  pr 

v 


where  7  is  the  value  of  the  memory  of  the  optimum  scheme  and  <5 ^ 
is  the  dispersion  of  noise  contained  in  7  *  (-/-) . 

-8  -  ' 


sec . 
easily 


(lM 


From  (12)  and  Q.4)  it  follows  that  the  addition  to  the  output' 
of  the  optimum  scheme  of  an  integral  term  in  accordance  with  formula 
(lO)  in  practice  does  not  increase  the  .random  error,  if-f  /  ^-  500  sec. 
Therefore  the  memory  of  the  optimum  scheme  should  be  determined  by  the 
conditions 

/  -  (:  for  /;  •*-  500  sec., 

'f  t.  500  sec  for  i  500  sec . 

In  this  case  formula  (14)  can  be  used  to  determine  the  dis¬ 
persion  of  random  errors  in  the  smoothed  coordinates  of  satellites. 


Beginning  with  the  moment  {  -  500  sec  the  lower  limit  of  the 
integral  in  the  right-hand  members  of  formulas  (9)>  (lO)  should  be 
replaced  by f- 5 00. 


It  can  be  shown  analogously  that  this  same  selection  of  f 
makes  it  also  possible  to  neglect  .u  {i  )  in  the  determination  of  \\  . 
Then  it  is  easy  to  find  the  pulse  transfer  function  of  the  scheme  for 
optimum  differentiation,  and  c~'3,y-  dispersion  of  random  errors  in 
determining  the  velocity  projections  of  the  satellite  —  is  described 
by  the  relation 


(15) 


Taking  for  an  example  we  obtain  from  (l4)  and  (15) 

that  in  200  sec  after  the  beginning  of  receipt  of  information  on  the 
satellite,  its  coordinates  and  the  projections  of  its  velocity  can  be 
found  without  dynamic  errors  and  with  random  errors  characterized  by 
the  values  cr-  -  200y;j ,  £-  *  -  1.7  m/sec. 
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